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A discrete time series has associated with it an amplitude spectrum 
which is a periodic function of frequency. This paper investigates the 
extent to which a time series can be concentrated on a finite index set 
and also have its spectrum concentrated on a subinterval of the fun- 
damental period of the spectrum. Key to the analysis are certain se- 
quences, called discrete prolate spheroidal sequences, and certain 
functions of frequency called discrete prolate spheroidal functions. 
Their mathematical properties are investigated in great detail, and 
many applications to signal analysis are pointed out. 

I. INTRODUCTION 

In many branches of technology, such as sampled -data theory, time- 
series analysis, etc., doubly infinite sequences of complex numbers, \h n \ 
= . . . , h-i, h , hi f ... Pl av an important role. Associated with such a 
sequence is its amplitude spectrum 

H(f) = t h n e 2 * in f. (1) 

In this paper we attempt to elucidate certain features of the complex 
relationship between \h n ] and its amplitude spectrum H(f). 

Of prime importance in the analysis we present are some special se- 
quences, here called discrete prolate spheroidal sequences (DPSS's), and 
some related special functions called discrete prolate spheroidal wave 
functions (DPSWF's). Much of the paper is devoted to a study of their 
mathematical properties. They are fundamental tools for understanding 
the extent to which sequences and their spectra can be simultaneously 
concentrated: they have many potential applications in communications 
technology. 
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We motivate our work by discussing a simple problem. But first some 
notation is needed. We adopt the abbreviation 

ffOibiH)- f \K\ 2 (2) 

n=n\ 

and refer to this quantity as the energy of the sequence \h n ) in the index 
range (rc 1,712). Throughout this paper we restrict our attention to se- 
quences whose total energy E = £(—<»,«>) is finite. Associated with a 
sequence is its amplitude spectrum defined in (1). It is periodic in / with 
period 1 and we shall generally consider it only for |/| < %, From the 
theory of Fourier series, we then have the representation 



"»-X 



1/2 

H(f)e~ 2 * in fdf, n = 0, ±1, . . . (3) 

1/2 

for the sequence, and from Parseval's theorem we have that 

J-LIM 1 - C n \Hif)\Hf. (4) 

c/l/2 

If H(f) is given, we say that the sequence \h n \ defined by (3) is the se- 
quence belonging to H and we write \h n ] **■ H (/). 

Now let W be a positive number less than %. If the amplitude spec- 
trum of \h n \ vanishes for W < \f\ < l k, we say that the sequence is band- 
limited and that it has bandwidth W. The elements of a bandlimited 
sequence can be written in the form 

Xw i 

H(f)e-** in fdf, 0<W<~, n = 0,±l,... (5) 
-w 2 

Analogously, given two finite integers, n\ < n% we shall say that a se- 
quence [h n \ is indexlimited to the index interval (n 1,712) if h n vanishes 
whenever n > n% or n < n\. It is not hard to see that, except for the trivial 
all-zero sequence, a bandlimited sequence cannot be indexlimited and 
that an indexlimited sequence cannot be bandlimited. 

It is natural now to ask just how nearly indexlimited a bandlimited 
sequence can be. Specifically, we seek the maximum value of the con- 
centration 

..s»ts.rrw.)/(j W ) • 

for all sequences of bandwidth W, and ask for which bandlimited se- 
quences the concentration attains this maximal value. The answers to 
these questions are simply stated in terms of the discrete prolate sphe- 
roidal wave functions Uk(N,W;f), the discrete prolate spheroidal se- 
quences \vlf*(pi,W)\, and their associated eigenvalues \k(N,W), k = 0,1,2, 
. . . , N — 1. The bandlimited sequence \h n \ of bandwidth W most con- 
centrated in the sense of (6) is proportional to the DPSS \v { nlN (N, W)\, 
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its amplitude spectrum is proportional to e ir{2No+N ~ 1) fUo{N,W\f) in 
the interval |/| < W, and its concentration is given by \ (N,W). 

In earlier papers in this series 1-4 we treated the analogous problem 
of the maximal time-concentration of a continuous signal /(t) of limited 
bandwidth. The optimal signals in that case, prolate spheroidal wave 
functions (PSWF's), were found to have many interesting and useful 
properties that were explored in related papers. 5-8 We here borrow freely 
from the techniques used in these earlier works and extend many of those 
results to the present case of discrete time series. Details of derivations 
that parallel closely ones to be found in Refs. 1-8 are sometimes omit- 
ted. 

Part of the material presented here has been anticipated by others. 
As early as 1964 C. L. Mallows in an unpublished work defined versions 
of the DPSWF's and DPSS's. He showed that the former satisfy a sec- 
ond-order differential equation and that the latter satisfy a second-order 
difference equation, and described a number of their other properties 
as well. Tufts and Francis 16 in 1970 showed the importance of the DPSS's 
in the optimal design of digital filters. Independently, Papoulis and 
Bertran 12 in 1972 made a similar application. Eberhard 17 in 1973 showed 
that the DPSS provide optimal design of a discrete window for the cal- 
culation of power spectra under a natural criterion. All of these later 
authors present some numerical values of the functions and of \o(N, W) 
for a few isolated values of N and W. None of them treat the subject as 
intensively as is done here. See Ref. 18 for some comments on these ap- 
plications. An interesting application in optics to the theory of image 
formation was made by Gori and Guattari 23 in 1974. 

Regarding the organization of this paper, in Section II we state without 
proof some of the more useful and interesting properties of the DPSWF's 
and the DPSS's. Included are curves and asymptotic formulae. In Section 
III we discuss some extremal properties and some applications of the 
functions. Of particular interest, perhaps, is the prediction problem of 
Section 3.2. In Section IV, proofs are given or outlined for the less obvious 
statements found in Sections II and III. 

II. THE DPSWF's, THE DPSS's, AND SOME OF THEIR PROPERTIES 

Throughout the remainder of this paper, unless otherwise explicitly 
stated, N is a positive integer and W a positive real number less than 

v 2 . 

2. 1 The discrete prolate spheroidal wave functions 

Since its kernel is degenerate, the integral equation 

-w smx(/-/) 
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has only N non-zero eigenvalues, \o(N,W), \i(N,W), . . . , \n-i(N,W). 
They are distinct, real and positive and we order them so that 

\ (N,W) > \i(N,W) >...> \ N -i(N,W) > 0. (8) 

There are N linearly independent real eigenfunctions of (7) associated 
with these eigenvalues and we denote them by Uo(N,W;f), Ui(N,W;f), 
. . . , UN-\{N,W',f). When these are normalized so that 

Xl/2 
t \U k (N,W;f)\ 2 df=l, 
1/2 






df 

k = 0,1,...,N-1, 

they are the DPSWF's. Thus, the discrete prolate spheroidal wave 
functions Uk(N,W;f) and their associated eigenvalues \k(N,W;f) are 
defined by 






f W smNir( f f ' ] U k (N, W;f')df = \ k (N, W) U k (N, W;f) 
J-w smir(f-f') 



W smNir(f-f') 
■w sinir(/-/') 

-oo</<oo ( k= 0,1,..., N-l, (10) 



along with (8) and (9) and the requirement that the Uk be real. 
The DPSWF's are doubly orthogonal: 



I 



' Ui(N,W;f)Uj(N,W;f)df 






-w 

= \i C 1/2 U i (N,W;f)U j (N,W;f)df=\ i 8 ij (11) 

J-l/2 

i,; = 0,l,...,AT-l. 

For k = 0,1, . . . , N — I, the function Uk (N, W;f) is periodic in /. It has 
period 1 if N is odd and period 2 if N is even. In either case we have 



while 



U k (N,W;f+ 1) = (-l) N - l U k (N,W;f), (12) 

U k (N,W; \~f)= KiNMUx-t-k (iV, \ - W;f"j 

\k (N, i - W") = 1 - \ N -i-k(N,W) (13) 

K(Nk) = l { - 1)(N ~ 1)/2+k ' N ° dd 
K ' ' 1(-1)<W 2 )- 1 , Neven. 
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Fig. 1— £4(4,0.4;/) for k = 0,1,2,3 and U k (5,0.4;/) for k = 0,1,2,3,4 for < / < 0.5. 



The DPSWF Uk (N, W;f) has exactly k zeros in the open interval -W < 
f < W and exactly N — 1 zeros in — % < / £ %. It is an even or odd 
function of/ according to the parity of k. Plots of some selected DPSWF's 
are given in Figures 1 and 2. Note the inserts with changed scales needed 
to show detail of U for 0.4 <f < 0.5 in Fig. 1 and for U 4 (5,0.2;f) in < 
/ < 0.1 in Fig. 2. Values of some X^ (N, W) can be obtained from the or- 
dinates of the curves of Figures 3, 4, 5 and 6 corresponding to integer 
abscissa values. Figure 7 shows the dependence of some \k(N,W) 
on W. 
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Let a(N, W) denote the N XN tri-diagonal matrix whose element in 
the ith row and j th column is 



/ 1 

-i(N-i), 

<N-1 



a(N,W)ij = 



j = i-l 



(- i\ cos2ttW, j = i 



(14) 



-(i + l)(N-l-i), j = i+l 

\o, |y-i|>i, 

i,j = 0,l,...,N-l. 

The N eigenvalues of this matrix are real and distinct. We denote them 
by 

o (N,W) > O^N.W) >..> On-^N.W). (15) 

Then the DPSWF's satisfy the differential equation 

d . dU k {N,W;f) 
— [cos oj - A] 

(Id) CIO) 



[I 



,W)] 



+ - (N 2 - 1) cos <o - d k (N,W) U k (N,W;f) = (16) 



where we write 



(17) 



w m 2irf, A = cos 2irW. 

2.2 The discrete prolate spheroidal sequences 

For each k = 0,1,2, . . . ,N - 1, the DPSS \v { n k) (N, W)\ is defined as the 
real solution to the system of equations* 

Ifcl sin 2*W(n - ») „ = Xk(NiW)v ik mwl (18) 



,=o ir(n — rn) 



n = 0,±1,±2, . . . 



normalized so that 



N Zv} k) (N,W) 2 = h 

>=0 



(19) 



Z uj k) (N,W) > 0, D (N - 1 - 2j)of ) (iV,W) > 0. (20) 





* It is understood here, of course, that when n = m the expression [sin 2irW{n — m)]/ir(n 
- m) has the value 2W. 
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Fig. 2— t/fc (4,0.2;/) for fe = 0,1,2,3 and U k (5,0.2;/) for k= 0,1,2,3,4 for < / < 0.5. 



The Xk(N,W) here are, as before, the ordered non-zero eigenvalues of 
the integral equation (7). These quantities are thus seen to be also the 
eigenvalues of the N X N matrix p(N, W) with elements 

,. Mm sin 2irW(m - n) 

p(N,W) mn = : : , m,n = 0,1,... ,iv- 1, (21) 

7r(m — n) 

and the (N - l)-vector obtained by indexlimiting the DPSS \u { n k) (N,W)\ 
to the index set (0,N — 1) is an eigenvector of p(N,W). 
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Fig. 3— Values of A*(N,0.4) for k = 0, . . . , 15 and N = 0,1, .... 20. 



The DPSS's are doubly orthogonal: 

)U)(M U7\ = \- ^T 1,(0 



V v$HN, W)v^(N, W) = \i £ v%HN,W)vlt\N,W) = 8y (22) 

n=0 



i,j = 0,l,...,N-l. 
They obey the symmetry laws 

v™(N,W) = (-1)* uJJit-nWW) 

pfWW) = (-i) k vffsir n k) (N, % - wo, 

n = 0,±1,±2, . . . 

fe=0,l,...,AT-l. 



(23) 
(24) 




Fig. 4— Values of Mn.0.2) for k = 0, . . . , 9 and N = 0,1, ... 20. 
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9 10 11 12 13 



Fig. 5—1 - \ k (N,0A) for k = 0, . . . , 7 and N = 1,2 13. 

The DPSS's indexlimited to (0,N — 1) satisfy the difference equa- 
tion 

-n(N-n)v { n k MN,W) 



+ 



["cos 2ttW (^—^ - n V - k (N, W)] v { n k) (N,W) 



+ l(n + l)[N-l-n}vl l k UN,W) = 0, (25) 



k,n= 0,1,... ,N -I. 
Here the 0's are as in the differential equation (16). 
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Fig. 6—1 - \ k (N,0.2) for k = 5 and N = 1,2 13. 



2.3. Connections between the DPSWF's and the DPSS's 

We have 

U k (N,W;f) = € k Z vPWWe-t'W- 1 - 2 "* 

n=0 



k=0,l,...,N-l, 



where 



(k = 



1, k even 
i, k odd. 



(26) 



(27) 
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Fig. 7— \ k {N, W) = Xfe(N) vs. W for several values of k and N. 



Conversely, 



u l n k) (N,W) = - C' 2 U k {N,W\f)e i *W- 1 -Wdf 

€b J -1/2 



l r l/2 

n,* = 0,l,...,iV-l. 



(28) 



But, one also has 

u m iN>W) = —-L— C U k (N,W;f)e^ N - l -Wdf (29) 
€ k \ k (N,W) J-w 

fe = 0,l N-l 

for all values of n. 

It is convenient now to introduce the bandlimiting operator Bw de- 
fined by 

B H<n-\ mfl in ~ w (30) 

Bwmi) -\ o, |/| > iv (30) 

and the indexlimiting operator 1$ defined by 

lfH\h n \=\gn\ 
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(31) 



where 

m thn, N 1 <n^N 2 
0, otherwise. 

In terms of these operators, (28) and (29) can be stated 

tklf-HftPWW)] ** U k (N,W;f)e^ N -^ (32) 

e* \ k (N, W)K k) (N, W)\ - B w U k (N, W;f)e"W~Vf. (33) 

For the sequence \u ( n k) (N,W)\ belonging to the DPSWF U k (N,W;f) we 
have 

/»l/2 

ui k) (N,W)= I U k (N,W;f)e- 2 * in fdf 

J-l/2 

fN-1 



N 



/ iV-l , A 

-i sm7r (~2 — V 



dV-1 



*(—+»-;) 



uj*>(A/,W0 



(34) 



,(k) 



u { n k) (2M+l,W) = 



(35) 



n = 0,±1,±2, . . . 

When N = 2M + 1 is odd, this reduces simply to 

e k v$ M (2M+l,W), \n\<M 
0, |rc|>M, 

a multiple of the indexlimited shifted DPSS. Equation (29) shows that 
conversely the spectrum of the shifted DPSS is in this case a multiple of 
the bandlimited DPSWF, 

< k \ k (2M + l;W)\v$ M (2M + 1,W)\ - B w U k {2M + l,W;f). (36) 

2.4. Asymptolics of DPSWF's 

In what follows, in addition to (17) we adopt the abbreviation 

a = 1 - A = 1 - cos 2irW. (37) 



A. U k (N,W;f) for fixed k and large N 
When N is large and W and k are fixed, 



U k (N,W;f) 



(cifi(u), < a> < N~ 1 ' 3 

02/2(0), N" 1/3 < o < arccos [A + JV~ 3 / 2 ] 

03/3(0), arccos [A + AT" 3 / 2 ] < o> < 2ttW (38) 

03/4(0), 2ttW < o> < arccos [A - AT" 3 ' 2 ] 

1 05/5(0;), arccos [A — iV~ 3/2 ] < o> < ir. 
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Here 



//./V 2 \l/4 \ 

ftw -*y -) 



[Vl + cos a; + Vcos a? - AP 
[(l-cosfa))(coso;-i4)] 1/4 

"lfc+1/2 



Vl - COS CO I' 

Va(l + cos o>) + V2(cosa> -A) J 



/s(«) = /o ( V N _ ^cosco-a) (39) 



/ 4 (co) = «/ f / _ VA - cos o> j 

/b(«) 

cos — arcsin 0(o>) + - (k + - 1 arcsin 0(o>) + (fe - iV) - + — I 

[04 - COS fa))(l - COS fa))] 1/4 

n/ . a + 2 cos oj , . , (2 - 3a) - (2 + a) cos co 

0(o>) = — , 0(«) = — — — : — 

2- a (2 - a) (1 -cos a;) 

where D k ( • ) is the Weber function (Ref. 9, Vol. II, Chapter VIII), and 
/o and Jo are the usual Bessel functions. The constants in (38) are given 
by 

d = (-l)l* /2 )(/z!)- 1/2 7r y i2 y 2a y 3iV>'4[v / 2 + V^) Ys [2 - a] y « 



i 


Vi 


y 2 


y 3 


Y 4 


v 5 




Ye 


1 


1 
4 


Vs 


i 

8 


1 
4 










2 


1 
4 


4 8 


* + § 

4 8 


2 4 


-N 







3 


3 
4 


4 8 


4 8 


1 + 3 

2 4 


-N 


(N- 


k - l)/2 


5 


1 
4 


4 8 


4 8 


A 1 
- + - 

2 4 


-N 


]+(N 
4 


- ft - l)/2. 



(40) 



B. U k (N,W;f) for large N and ft = |.2WN(1 - «)J 
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When k and N become large together with 

k = \_2WN(l - e)J, < t < 1 (41) 

and e fixed, then 

U k (N,W;f) 

I dxgxio)), < co < arccos (B + N~ 1/2 ) 

digziw), arccos {B + N~ 1/2 ) < a < arccos (B - N~ 1/2 ) 
dsgsiw), arccos (B — N~ l/2 ) < co < arccos (A + N~ l ) 
d&tiu), arccos (A + A/" 1 ) < a < 2irW 
d^sM, 2irW < co < arccos (A — N~ l ) 
\ deg 6 (u)), arccos (A — N' 1 ) < co < ir. 
Here B is determined so that 



(42) 



/-Vsr 



.(£-A)(l-£ 2 ) * N 
and 



f -- n *-i- («) 



[N /•« „ /cos t — B , 
v I V — ;— 7 di 
2 Jo cos t — A 

_C p g (l-(-,l)*)fl 

4 Jo V(cos£ -B)(cos£ -A) 4 J 



jV2/3 (cos w _ B) 



* 2(<0) " Al r [4(1 -B»)(B-A)]W 



r,, x [ N r» . IB — cost _ 
g 3 (o>) = fl(co) exp - - V 1 7 dt 

L 2 J arccos B COS t — A 

_c r« dt "I 

4 Jarccos B V (B — COS £)(C0S t — A) A 

* 4 <«) = /o (N Vfff^ (cos co - A)) (44) 

g 5 (co) = Jo (N V^ff^ W " cos co)) 

„(«)-*(«) oo. [- J_ Vjz^t* 

4 Jo, V(B - cos t)(A - cos t) J 
fl(co) = |(5 - cos co)(A - cos to)!" 1 / 4 . 
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The function Ai(x) is the Airy function defined in Ref. 10, page 446. The 
parameter C here is given by 

C = f [^L 1 + (2 + (-l)*)f| (45) 

Z/2 L 2 4Jrem 2x 

where [x] rem 2* = x — 2iz\_xl2ir\ is the number between zero and 2ir 
congruent to x modulo 2ir, and the parameter 6 in #6 is 

•■fi-f^-x^l • (46) 

L4 2 4 Jrem2T 

The L's are given by 

Li= C l P(&dt L 2 = C'QWZ 
Jb Jb 

U = J^ P(£)d£ L 6 = J^ QWZ = L 2 

ltt-A)(l-p)l 

The L's can be expressed simply in terms of complete elliptic integrals 
of the first and third kind. (See Ref. 13, pages 242 and 265.) (The inte- 
grals in (44) can also be expressed in terms of elliptic functions, but the 
resulting expressions shed no light on the nature of the solution.) Finally, 
the d's in (42) are 

di = LZ 1/2 ir 1/2 2 1 '* 

d 2 = L 2 - 1/2 t2 1 ' 3 (1 - B 2 )-i/ 12 (B - A)- l 'W e 

d 3 = L 2 - 1/2 7r 1 / 2 2- 1 / 2 

d 4 = Ll m tt(1 - A 2 )- l '*e- CL <l*e- NL *l*NM 

d 6 = L 2 - ,/2 r m<im e -cun e -NLii2 (48) 

C. U k (N,W;f) for large N and k = 1.2 WiV + (6/tt) log AT J 
When N -* °° and 

ft =L2WN+ (6/tt) log NJ (49) 

with b and W fixed, we have asymptotically in N 

icifii(w), < to < arccos [A + N~ 2/a ] 
e 2 /i 2 (co), |cos co - A | < N-2/ 3 (50) 

63/13(0;), arccos [A — N~ 2/3 ] < co < 7r. 
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Here 



Mco) = 



Vcos co — A 



cos 



N E0 
7 a, + y log 



CO 



0(1 + A) tan - + 1 



0(1 + A) tan - - 1 



-»l 



h 2 (o>) = eimm<*» o.-A)$ /l . ,• Ei f 1; -ipN(cos co - A)) 

i 
/i 3 (co) = 



(51) 



VA - cos co 



X cos 



N E0 

— co -i log 

2 2 6 


0(1 + A) tan- + 1 


0(1 + A)tan^-1 



and 



/3=|csc2ttW| 



*/ \ 1 . a x , q(q + i) * 2 , 

<*>(a,c;x) = 1 + - — + -. — — tt+... 



-ft + Dj 



(52) 



c 1! c(c + 1) 2! 

is the confluent hypergeometric function in the notation of Ref. 9, Vol. 
1, Chapter 6. The constant E is to be determined as the root of smallest 
absolute value of 



NwW+ m log m. +HEffi - k z-E =0 _ 



Here we have written 



1 1 . 



r/---is)=r(s)e''*< s > 



(53) 



(54) 



where r, \{/, and s are real and T is the usual gamma function. 
The constants in (50) are given by 

J 1/2 



U[l + e* £ 0]logNj 
e 2 = r(E^)VpNe^'^ E ^e l 
e 3 = e U/2)^ ei . 



(55) 



D. U k (N,W;f) for large N and k = [2WN{1 + e)J 

The case of large N with k = |.2 WN(l + e)], < e < 1/2W - 1 can be 
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reduced to case B above by means of the formula (13). One finds 

U k (N,W;f) = K(N,k)U k > (n,W; |-/) (56) 

where U k >{N,W'}l 2 -{) can be obtained from (41)-(48). Here 

W' = --W 
2 

k f = N-l-k~ 2W'N(1 - e') (57) 

E. U N -i(N,W;f) for fixed £ and large N 
Formula (13) reduces this case to case A above: 

U N - £ (N,W;f) = K(N,N - £)U e -x (#, |- W; | - /) 

where formulas (38)-(40) can be used to obtain asymptotic values for 

Ue-i(N}l 2 -W-}l 2 -f). 

2.5 Asymptotics of the eigenvalues X* ( N, W) 

For fixed k and large N, one has 
1 - \ k (N,W) ~ 7r 1/2 (/z!)- 1 2< 14fe+9 > /4 a( 2fe+1 ) /4 [2 - a ]-(k+im N k+i/2 e -yN 



a = l-cos27rW, 7 = log [l + "J _°V ] 



(58) 



Some values computed from this expression are shown as dotted lines 
on Figs. 5 and 6. The fit with Xo is very good for N > 2 when W = 0.4 and 
for N > 6 when W = 0.2. 
For large N and k with 

k = L2W2VU - c)J, < t < 1, 
1 - \ k (N,W) ~ e -cuii e -LiN ( 5 9) 

Here the L's are given by (47) with B and C determined from (43) and 
(45). 
For large N and k with 

k = \_2WN+(b/ir)\ogN\ 

XkiN.W)-—!—-- (60) 

1 + e T " 

A good approximation to A*. (AT, W) when 0.2 < X < 0.8 is given by 

X/eOV.WO-U + e^]- 1 (61) 
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where 

, 2rlNW-k/2-y 4 ] 

\og[8N\sin2irW\]+y 

where 7 = 0.5772156649 is the Euler-Mascheroni constant. Some values 
of (61)-(62) are shown on Fig. 3 for k - 7 and 13 and on Fig. 4 for k = 3 
and 6. Near X = % the discrepancy between the true value and the for- 
mula (61)-(62) cannot be seen on the scale of Figs. 3 and 4. 

Asymptotic values for A* {N, W) with N large and N — k = £ fixed can 
be obtained directly from (13) and (58). In a similar way, (13) and (59) 
provide an asymptotic formula for \k(N,W) when k = \2WN(1 + c)J, 
< € < 1/2W - 1. One has in this case 

X* (N, W) ~ e -CL 4 /2 e -l 3 n ( 63) 

where C, L3, and L4 are to be computed from (43), (45) and (47) with W 
replaced by V2 - W and k replaced by N — k — 1. 
For fixed k and N, but W small, we find 

\k(N,W) = - (2irW) 2k + l G(k,N)[l + 0(W)] (64) 

■K 

where, for example 

G(0,N) = N 

G(l,N) = ^-(N-l)N(N + l) 
36 

1 
G{2,N) = — — (N - 2)(N - l)N(N + 1)(N + 2) 
8100 

Q2A/-2 

G(N - l,N) = . (65) 

The general term is 

92A(M)6 k 

M - » t itiw A l,, - ft (66> 

For fixed k and N, but W near V2, i-e., 1 ^ - W > small, (13) combined 
with (64) gives 

l-\ k (N,W) 

= - G(N - 1 - k,N)[ir(l - 2W)] 2(N -* ) - 1 [l + 0(1 - 2W)]. (67) 

7T 
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2.6 Relationship to PSWF's: W^ 0, N^ », vNW '-» c > 

The prolate spheriodal wave functions (PSWF's) ^,(c;x) and their 
associated eigenvalues A,(c), i = 0,1,2, . . . are defined by 

i sin c(x — x') 

Mc;x')dx' = K(c)Mc;x), (68) 



I 



-l tt(x — x') 

-co < X < °o 

Ao ^* Ai > A2 . . . 
J^?(c;x)dx=l, M0)>0, ^(0)>0 (69) 

i = 0,1,2, .... 

For each i = 0,1,2, . . . the PSWF 1/7 (c;x) satisfies the differential equa- 
tion 

j- (1 - x2) ^ + [ x - c*x% = (70) 

ax ax 

for a special value 

X = Xi(c) (71) 

of the parameter x- The PSWF's and the quantities A,(c) and Xt(c) are 
discussed in detail in Refs. 1-6. 

Now let c > and y, a real number, be given. If, as 

W-0,N=|^J andn = |^(l+y)J (72) 

then 

A.UV.WO-A^c) 
VW Ui (N, W; Wf) ~ fc (c,f) (73) 

■\/%v!i\N,W)— j==fi(cv) (74) 

2 vA,(c) 

N*-l-2d i (N,W)~ X i(c). (75) 

In (74) when i is even the plus sign is taken when S-\^i(c;x)dx > 0; if 
i is odd, the plus sign is taken when J"L 1 xi/',(c,x)dx > 0; otherwise, the 
negative sign is to be used. 

III. APPLICATIONS 
3.1 Extremal properties 

3. 1. 1 Most concentrated bandlimited sequence 

To maximize (6) over the bandlimited sequences, we replace h n 
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there by its representation (5) and use (4) to obtain 

No+N-l fW f*W 

L 

=N 



x = 



wo+n-i /* w r w — 

Z I df ( df'H(f)mf')e-*™«-n 
n=No J-w J-w 

f_ W w \H<f)M 

JW r w sin Nir(f - f) — 

-W J-w simr(/-/') 



X 



w 
_ w \H(f)\*df 



Xw r w sin AM/ - /*') 
■w J-w sin7r(/— /') 



X 



w 

WDM 

— rr 



(76) 



Here we have written 

,/,(/) ■ e-^Wo+N-DfHtf) (77) 

and used the fact that 

No+ f~ l e -2«W-/') = e -i*Wo+N-iW-n *inN*if-f') 

No sin w(f - /') 

A simple variational argument applied to (76) shows that X is stationary 
when yf/ satisfies (7) and hence the maximum value of X is Xo(N,W), at- 
tained when \f/(f) = cU (N,W;f), |/| < W. Equation (77) then shows that 
the most concentration bandlimited sequence is 

ce i 1 r(2No+N-i)f u (N,W;f), |/| < W 



lh n \~H(f) = 



o, w<|/|<y 2 . (78) 



For the sequence itself, we then find from (5) 

h n = c f W UoiNWfte^W-i-Xi-HoWdf 
J-w 

whence from (29) 

\h n } = d{v<?l No (N,W)\ (79) 

where d is independent of n. The results (78) and (79) were stated in 
Section I after eq. (6). 

More generally, for k = 1,2, . . . , N - 1 we have that d\v { n k 2 No (N,W)} 
is the bandlimited sequence most concentrated in (Nq,No + N — 1) that 
is orthogonal to {i>£!n C/V, WO), i = 0,1, . . . , k — 1. The fraction of its en- 
ergy in the range (N ,N + N — 1) is X* (N, W). 
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3. 1.2 Indexlimited sequence with most concentrated spectrum 

If \h n \ is indexlimited, so that 

{0, n < N 

h n , N Q <n<N + N-l 
0, n > No + N - 1, 

and if H if) **\h n \, then 

fVvjw Wo E" Wo r i sin2 ; 1V( "- m) ^ 

»/-W n=N m=No ^(n — m) 

M = 



X 



1/2 , No+N-1 , , n 

, \H(f)M L l^l 2 

-1/2 No 



w-i N-i sin 2tt W(n-m) , r 
Z, Z, ; ; ri n+ N n m +No 

n=0 m = "Tl^ ~ HI) 

N-l 

£ \h n+ N \ 2 




(80) 



Here we have used (2) to replace H(f) in the numerator, and have used 
(4) to rewrite the denominator. The quantity n is a natural measure of 
the extent to which H(f) is concentrated in the frequency interval 
(- W, W). Comparison of the right member of (80) with (18) shows that 
M will be a maximum when h n+No = cv ( ®(N, W), n = 0,1, . . . , N - 1. Thus 
the indexlimited sequence with most concentrated spectrum in - W < 
f<Wia 

0, n <N 

\h n \* v®l No (N,W), N <n<N + N-l (81) 

0, n > No + N - 1. 

The concentration of its spectrum H(f) is n = \o(N,W) and 

H{f) = dU (N,W;f)e iirl2No+N - 1)f , V/ (82) 

with d independent of /. 

More generally, for k = 1,2, . . . , N - 1, /#£*"- W-^W W0) is the 
indexlimited sequence with most concentrated spectrum in — W < f < 
W that is orthogonal to 

lT N ~ l ^n-N(N,W)\ i = 0,1, . . . ,k - 1. 

The fraction of its spectral energy in |/| < W is \ k (N,W). 
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3. 1.3 Simultaneously achievable concentrations 

Let \h n \ **■ H(f) and consider the two measures of concentration 
No+N-l r w 



)+7V-l f w 

E M 2 J \H(f)\*df 



/»l/2 

ElM 2 ) , \H(f)M 

— CD «/ — 1/2 



What values of a and /? are possible? 

Just as in Ref. 2, pp. 74-77, one finds the attainable nonnegative values 
of a and are given by the intersection of the unit square < a < 1, 
< /3 < 1 and the elliptical region 



a 2 - 2a(3V\ (W,N) + (3 2 <l- \ (W,N). 



The elliptical boundary cuts the square at or = 1, /3 = Vx (V^,N) and a 
= V\q(W,N), (3 = 1. As either N gets large, or as W — V 2 , X (W,N) — 
1 as seen by (58) and (67), and the attainable region becomes the unit 
square. 

3. 1.4 Minimum energy bandllmlted extension of a finite sequence 

Let numbers ho, hi, ... , fyv-i be given. There are infinitely many 
ways that one can choose numbers h^, /ijv+i, • • • and h-\, h~% ... so that 
the infinite sequence \h n \ is bandlimited. Which of these sequences has 
least energy? 



The answer is 



where 



hn = N Zc X jvlJ ) (N,W) (83) 

;=0 

n = 0,±1,±2, . . . 



a j = N Eh n vH ) (N,W) (84) 

;=0,l,...,iV-l. 
The energy of this bandlimited sequence is 

^I^^SmSo- (85) 

The dual to this problem is the following: Let H(f) be given for |/| < 
W. Consider extensions of// to the interval |/| < % that correspond to 
sequences \h n \ ** H{f) that are indexlimited to the index set (N , 
No + N — 1). Which such extension has least energy? 

The situation is quite different here from the dual just discussed. Given 

1392 THE BELL SYSTEM TECHNICAL JOURNAL, MAY-JUNE 1978 



I 



an arbitrary H{f), \f\ < W, in general there is no way to extend it so that 
the corresponding sequence will be indexlimited. The extension can be 
accomplished only if for |/| < V2 

No+N-l 

H(f) = E Ke 2 * in{ 

No 

or stated another way, only if for |/| < W we have 

H(f) = e 2*i(N 0+ N-m)f N £ aj Uj(N;W;f). (86) 

Then, of course, 

a.=- ( H(f)e-W N <> + l N -» /2 VUj(N,W;f)df 
\j J-w 

by (11). But (86) for |/| < V2 is then the extension sought of minimum 
energy. Its energy is 

• 1/2 N-l 

\H(f)\ 2 df= £ af. (87) 

'-1/2 y=o 

The distinction between the two cases just treated arises, of course, 
because the Hilbert space of indexlimited sequences is finite dimensional 
while the space of bandlimited sequences is of infinite dimension. 

3. 1.5 Trigonometric polynomial with greatest fractional energy In an 
Interval — optimal windows 

Let g(f) be a function of the form 

g(f)= N t 1 g k e- i ^ N - 1 - 2k) f. (88) 

k = 

If N = 2M + 1 is odd, this can be written 

M 

g(f)= E g n e 2 ™f (89) 

n=-M 

and if N = 2M is even it can be written 

M 

g(f)= L g n e^ 2 »-»f (90) 

n=-(M-l) 

where £ n and £ n are suitably defined. In either case g(f) can be called 
a trigonometric polynomial. 

For functions of form (88) one readily computes 

s»W N-l 

( \g(f)\ 2 df L p(N,W) mngm g n 
A=^ = ^ (91) 

Xl/2 N-l 

\g(f)\ 2 df E \gn\ 2 

1/2 
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with p{N,M) given by (21). Comparison of (91) with (18) and (26) shows 
that Uo(N,W;f) is the trigonometric polynomial of form (88) having the 
largest fractional concentration of energy in (— W,W). 

Applications of this fact have been made to digital filtering, 12 ' 16 - 18 to 
spectral estimation, 17 and to the definition of an essentially band-limited 
process by Balakrishnan 19 in 1965. In most of these applications, N is 
odd, and the §k of (89) are required to be real and even in k. Thus for 
functions of form 

M 

g(f) = 2a + £ a, cos 2irjf 

i 

with the a's real, one desires to choose the a's to maximize the fraction 
of the energy of g in (— W,W). The answer is 

aj = vtilj(2M +1,W) j = 0,1, . . . , M 

and 

g(f) = cU (2M + l,W;f). 

This basic property of U can clearly make it of special interest in many 
fields. 

3.2 A prediction problem 

N successive samples spaced To seconds apart are taken from a sta- 
tionary white noise X(t) of bandwidth Wo and mean zero. The linear 
predictor formed from these samples that has minimum mean-squared 
error is used to estimate the next sample value of X(t). What is the 
mean-squared error of this prediction, and how fast does it decrease with 
N? 

We write Xj = X(jTo). Let the observed samples of X(t) be Xo, X\, 
. . . , Xjv-i- Then the predicted value .& of X^ is to be of the form 

N-l 

o 

where the a's are chosen to minimize i] = E{X — Xn) 2 - The solution to 
this problem is well known. (See Ref. 11, pp. 302-305, for example.) The 
least value possible for tj is 

770 = mm rj = (92) 

a's Ayv 

where Ag is the £ X £ determinant whose entry in row i and column j is 
EXiXj, i,j = 0,1, . . . ,£ — 1. For the white noise case at hand this entry 
is 

9 8in27rW r (i-y) a^_ 



•> w 7 a ,"i ow t P( N > w oTohj 
2irWolo(i —J) 2VV ^0 
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in the notation of (21). Here a 2 = EX(t) 2 is the noise power. Since the 
determinant of a matrix is the product of its eigenvalues, it follows 
that 

2 UX k (N+l,W T ) 

•"ife^ * (93) 

II \k(N,W T ) 
o 

We can now use our knowledge (Section 2.5) of the asymptotics of the 
Xk (N, W) to find the behavior of 770 for large N. It is shown in Appendix 
A that for 

0<W o T o <±, 

lim -J- log ifo = log (sin tt W T ) 2 . (94) 

Thus the mean-squared error of the best linear prediction vanishes ex- 
ponentially in N when the sampling rate 1/To is greater than the Nyquist 
rate 2 Wo. The exponent decreases in absolute value towards the limit 
zero as the sampling rate is decreased to the Nyquist rate. 

The situation is very different when WqTq > l k- Then 770 approaches 
a limiting positive value, Tjo,, as N gets large. We find (see Appendix A) 
that 

|<w r <^p, » = i,2,... 

A plot of Tja, for V2 £ W To < % is shown in Fig. 8. Examination of (95) 
shows that tj^ = a 2 for W T = n/2, n = 1,2, — , and that the loops be- 
tween these values shown in Fig. 8 get smaller and smaller as WqTq in- 
creases. Thus, while rj m is zero for all sampling rates greater than the 
Nyquist rate, 7? m > 0.94 for rates less than 1/2 Wo. 

The foregoing is, of course, an unrealistic model of a physical predic- 
tion scheme in that it assumes perfect knowledge of the samples. If one 
assumes that to each sample X(jT) an independent observation noise 
Yj is added, then the linear predictor takes the form 

X = N ± 1 a j (X j + Y J ). (96) 



If we assume that X is a prediction of the noisy next measurement 
X(NT) + Yn, then all proceeds as before with the matrix p replaced by 
p + (2WoTqh/o 2 ) I where n = EYf and / is the unit matrix. By replacing 
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0.98 




0.96 - 



0.94 



Fig. 8 — Best mean squared error 77= vs. W T . The noise variance a 2 = 1. 



\k(N,W T ) by 2W Toh/<j 2 + X k (N,W To) one finds readily that 

s/ 






s=—2W Q T Q + n 
a* 



(97) 



|<^»^ 



n = 0,1,2, . . . 



When n = 0, so that sampling takes place faster than the Nyquist rate, 
Tjoo is positive. Indeed, rjo, rises monotonically from the value ^ at To = 
to the value n + a 2 when WqTq = %, as might be expected; perfect 
prediction is no longer possible. 

A more satisfying model would add independent noise to the observed 
samples, but require % to be a best linear predictor of X(NT) itself, 
rather than of X (NT) plus noise. The asymptotic behavior of 770 in this 
case seems more difficult to obtain. A related problem is readily solved, 
however. 

Let X as given by (96) now be a minimum variance estimate of Xn-i, 
where as before the Y t are independent identically distributed random 
variables that represent the imprecision of the measurement process. 
We are now not trying to predict Xjv but rather to eliminate the noise 
and estimate Xjsj-i correctly. One then finds for the mean-squared 
error 



Vo =M 



1- 



N U [<t> + K(N - 2,W Q T )) 

k=0 



where 



Vfo + MN-l.WVTo)] 



2W Q To 



(98) 
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Again using the techniques of Appendix A, we find in this case that 

--4 1 -^( 1+ ^) ] (99) 

|<W T <^, n -0,1,2,... 

Equation (99) can be obtained as a special case of a filtering problem 
solved by Viterbi. 20 He uses the result of Szego that 

lim %±i = exp C 1 ' 2 log mf)df (ioo) 

where Qm is the determinant of the N X N Toeplitz matrix having /i,_/ 
as the entry in the ith row and y'th column. Here, as usual, \h n ] ** H(f) 
and we require that h- n = h n , so that H(f) is real. Szego's result can in- 
deed be applied to the ratio of determinants in (92). The Poisson sum- 
mation formula, Ref. 14, p. 466, gives 

for this case where x(f) = 1 if I /I — 1 and zero otherwise. Carrying out 
the details one finds (95) again, but finds only that 

lim 7jo = 

TV— *> 

when WoTq < %. Our detailed knowledge of the A's has permitted cal- 
culation of the rate at which 770 approaches zero as expressed in eq. 
(94).* 

3.3 The approximate dimension of signal space 

The DPSS's \ujf\ k = 0,1, . . . , N - 1 are bandlimited to (-W.W) (see 
(33)). The concentration of \v^\ is given by 

««, *-0,l,...,N-l 

E( — 00, a>) 

[see (22)]. From the results of Section 2.5 we have seen that as N -*■ «>, 
K k — 1 if k = 2WN{1 - e), while if k = 2WN(1 + e), X* -* 0. And this is 
true for any t satisfying 1 > € > 0. Thus a fraction arbitrarily close to 2 W 
of the bandlimited DPSS's are confined almost entirely to the index set 



* Note: After the work in Section 3.2 was completed, it was called to my attention that 
Widom 22 has derived an important extension of Szego's theorem which applies to the case 
at hand here and gives the stronger result 770 ~ k [sin irWoTo] 21 ^ with k given explicitly to 
replace (94). The derivations of (94) and (95) given in the present paper are felt to be of 
interest in their own right and serve to verify the accuracy of the results given in Section 
2.5. 
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< n < N — 1. The remaining DPSS's have almost none of their energy 
in this index set. 

The facts just noted can be summarized loosely in the statement that 
"for large N the set of sequences of bandwidth W that are confined to 
an index set of length about N has dimension approximately 2 WN." This 
basic intuitive notion can be made precise in a number of ways. We prefer 
the following method which treats bandlimiting and indexlimiting 
symmetrically. 

Denote by / the index set J = {0,1, . . . , N — 1}. Now let c > be given. 
Denote by G t the set of finite-energy sequences \h n \ ** H(f) for which 



and 

Ew- 



E]= L \h n \ 2 << (101) 

nil 



C \H(f)M<e. (102) 

Jl/2>|/|>W 



If € is small, members of G ( have little energy outside the index set (0, 
N — 1) or outside the frequency range (—W,W). Now let M = 
M(N,W,€,e') be the smallest integer such that there exist fixed sequences 
\gn% \Sn\ • • , \S l n M) \ such that for every \g\ E G f a's can be found for 
which 

N-l f M 12 

E Ign-Eajg^l <<'. (103) 

n=0 L 1 J 

In words, M is the dimension of the smallest linear space of sequences 
that approximates G ( on the index set (0,iV — 1) with "energy" error less 
than (.'. 

With these definitions out of the way, the key theorem on the di- 
mension of signal space can be stated as follows. 

Theorem: If l k>W>0 and e' > € > 0, then 

,. M(N,W,e,(') nm ,_, x 

lim = 2W. (104) 

N-co N 

Proof of this theorem follows very closely that given in the Appendix 
of Ref. 7 and will be omitted here. 

For applications of this theorem it is important to note that the DPSS's 
{uj,**}, for k = 0,1, . . . , 2NW(\ — rj) for suitable choice of rj, can be used 
as an orthogonal basis for the Af-dimensional space of sequences that 
best approximates G t in the sense of (103). Thus if N is large and one is 
dealing with sequences known to be approximately of bandwidth W and 
very small outside the index set (0,N — 1), 2WN numbers suffice to de- 
scribe the sequence — namely, the first 2WN coefficients a, in the ex- 
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pansion of the sequence \h n \ on the appropriate DPSS's. We have then 

2WN-1 

h n ~ E a iV ^(N,W) (105) 



and 

ai~ N ± 1 h n v$ ) (N,W). (106) 

o 

Of course when N is large and W < %, 2WN « iV so that the savings can 
be considerable. 

Possible applications of the foregoing ideas to picture processing, 
cryptography, bandwidth compression and other sampled data systems 
should be evident. In many such applications, one starts with a signal 
x(t) G L 2 (— m ,°°) defined for all time. A sequence \h n \ is derived from 
x (t) by sampling at rate 1/Tq so that 

h n = x(nT ), n = 0,l,.... (107) 

If X(f) is the spectrum of x(t), so that 

x(t) = f " XifteW'df, (108) 

then 

H(f) = E h n e 2 * in f = E e 2 -'"/ f°° X(f')e** inT °f'df 

by the Poisson summation formula (Ref. 14, p. 466). If now X(/) vanishes 
for |/| > W and if T < 1/2 W , then H (/) = for W < \f\ < V 2 where 
W = WqTq < %. Thus when signals are sampled at rates greater than 
the Nyquist rate, the DPSS are of particular value in providing a succinct 
method of describing N-vectors of samples. 

An interesting application of these ideas forms part of a digital 
transmission scheme invented by Wyner to be described in a forthcoming 
paper by him. 

IV. DERIVATIONS 

4. 1 Basic facts of Section 2. 1-2.3 

An orderly development of this subject is facilitated by a few com- 
ments about the operators 



J-w sin 7r(/ - /') 
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and 

M = 7^ (cos 2-Kf - A) 4- + - (N 2 - 1) cos 2tt/ (111) 

At 1 df df 4 

that appear in (10) and (16). As before, we take < W < %, but now allow 
N to be an arbitrary real number. Operators of the type (110) and (111) 
have been well studied in the past and we borrow freely from the liter- 
ature. 
The kernel 

Kv-n- r^-J? (H2) 

Simr(/-/') 

is real, symmetric and square-integrable over the region |/| < W, \f'\ 

< W. The characteristic equation, L\f/ = \\p, therefore has as solutions 
a set of real eigenf unctions fa, fa, $% ■. . . that are orthogonal on |/| < W 
and complete in L 2 (—W,W). The corresponding eigenvalues are real, 
and those eigenvalues that are different from zero have a finite degen- 
eracy. The eigenfunctions and eigenvalues are continuous functions of 
the parameter N. The kernel of the operator L in (110) is defined for all 
values of /. The domain of definition of eigenfunctions of L belonging 
to non-zero eigenvalues can then be extended to the whole line — °° < / 

< °° by means of 

These eigenfunctions are readily seen to possess continuous derivatives 
of all orders. The eigenfunctions belonging to the eigenvalue zero can 
also be chosen to have derivatives of all orders. 
The characteristic equation for M, 

MU=dU, (113) 

is an example of the well studied Sturm-Liouville equation (Ref. 14, p. 
719). Let us denote by 11 the class of function continuous on |/| < W and 
piecewise twice differentiable there. Then (113) has solutions in V only 
for a discrete set of real values of 6, the eigenvalues of M, say 6 >6i> 
6 2 ^ . . . and a corresponding set of real eigenfunctions Uq, U\, . . . can 
be found that are orthonormal, i.e. that satisfy 

j'^ w U i (f)U j (f)df=5 ij . (114) 

Furthermore the Ui's are complete in jC 2 (—W,W). 

For our particular M, (111), all the eigenvalues are non-degenerate. 
For, suppose £/, and Uj are linearly independent continuous solutions 
of (113) belonging to the same eigenvalue 8. From MUi = 0£/, and MUj 
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= OUj we obtain UjMUi - UiMUj = or 

Uj ^ (cos 2t/ - A) ^ - C/i y. (cos 2tt/ - A) ^ 
d/ a/ a/ a; 

-±c-*,-4>[a,f-i*f]-a 

Integrate this last equation from / = - W to a generic point /' with - W 
<f <W. We find that 

Vj(n £m. Ulin iMl m0k - w <r<w, 

df af 

which contradicts the assumed linear independence of £/, and Uj. 
The non-degeneracy of all eigenvalues permits us to write 

0o > 0i > 02 > • • • (115) 

It follows then from well-known theorems that Uk (f) has exactly k zeros 
in the open interval |/| < W. That an eigenfunction U cannot vanish at 
either f ■ W or / = — W follows directly from the differential equation. 
For if U vanishes at / = W, for instance, 

— (C08 2X/-A) — ---2,/- 

+ \- (N 2 - 1) cos 2-irf - fl 1 t/« (116) 

evaluated at/ = IV shows that dU(W)/df = 0. Differentiate (116) and 
evaluate at / = W to see that d 2 U{W)/df 2 = 0. Continued differentiation 
shows that all derivatives of U vanish at f = W. But f7 possesses a Taylor 
series about f = W and so the assumption that U(f) = leads to the 
conclusion U = which cannot be. Thus U(W) ^ 0. 

We now know that both L and M possess orthonormal sets of eigen- 
functions belonging to V that separately span X 2 (- W, W). We show in 
Appendix C that L and M commute, i.e. for all g{f) £ *Z/, LMg = MLg. 
It is not hard to see then 15 that one can find a single set of orthonormal 
functions in V. complete in J. 2 (-W,W) that are simultaneously eigen- 
functions of L and M. Because of (115), however, the normalized ei- 
genfunctions Uk, k = 0,1, ... of M are unique except for sign. Thus the 
normalized solutions of (16) in C U, ordered by (115), are a complete set 
of eigenfunctions of L as well. 

Any continuous solution to (113) in |/| < % can be written as a Fourier 
series 

U(f) = e Miv-i)/ f c „e 2 «V. 
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Substituting this form in (113) we find the 3-term recurrence for the 
c's 

i r /N - 1 \ 2 i 

-n(N-n)c n _i + |A(— nj -0jc n 

+ ^-(n + l)(N-n-l)c n+l = 0, (117) 

n = 0,±1, . . . 

Note that the coefficient of c n -\ here vanishes if n = or n = N, while 
the coefficient of c n +i vanishes for n = — 1 and n = N — 1. Thus if N is 
a positive integer, which is the case of primary importance to us, the 
infinite system of equation (117) uncouples and we see that a solution 
is possible with = c-i = c-i — . . . — cn ■ c#+i = cw+2 = • • • provided 
that 

N £ a(N,W)ijCj = da (118) 

;-o 

i = 0,1 N - 1 

where the real symmetric matrix <t(N, W) is given by (14). Such a matrix 
has N real eigenvalues, which we now see to be eigenvalues of M as well. 
We denote them by U , 0, 2 , . . . , 0,> From (115) we know that i\,i%. . . , 
£jv are N distinct non-negative integers. We denote the real eigenvector 
of (t(N,W) corresponding to 0, ; by 

vM = (u^(N, W),v¥HN,W), ..., vfti^N.W)) 7, (119) 

/-1A....N 

and suppose these vectors normalized so that 

N L v^iNWv^iN.W) = b jk , j,k = 1,2, ...,N. (120) 
We denote the corresponding eigenfunction of M by 

UiAN,W;f) = N ± l v^HKWieW-i-W, j = 1,2, . . . , N. (121) 

n = 

Now again let N be a positive integer and denote by Sm the finite- 
dimensional space of functions of form 

g(f) = N i 1 gne i * (N - l - 2n)f (122) 

n = 

where go, g\, . . . , gN-i are arbitrary complex numbers. We have just seen 
that if N is a positive integer, M leaves §n invariant. Indeed, a simple 
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calculation shows that if g is given by (122), then 



Mg = g'{f) = £ 1 W WW " 1 " W ' (123) 

n = 



where 



g m = N Z <r(N,W) mn g n . (124) 

n = 

With N a positive integer, L also leaves <?jy invariant. (Indeed, in this 
case L projects all of X 2 onto Sn. ) If g is given by (122), one readily finds 
that 

Lg = g"(f) ^ "£ g" n e^ N - l -W (125) 

n=0 



where 



g' m = N Zp(N,W) mn g n (126) 

n = 



and the N X N symmetric matrix p (N, W) is given by (21). This is most 
easily seen from the fact that for integer N the kernel (112) is degenerate. 
Specifically, 

Sin AM/ - /') = A£l eiir{N -i-2n)f e -i*(N-l-2n)r t ( 12 7) 

sin7r(/ — /') n=o 

Since L and M commute, so do the matrices p(N,W) and a{N, W). 

We now show that for integer N the eigenfunctions of M spanning 9n, 
namely UiXN, W',f), j = 1,2, . . . , N, belong to the N largest eigenvalues 
of M, namely, d , 9\ % . . . , 9n-\> We order the integers ij so that 0,-, > (?,- 2 
> . . . > 0i N , so that our task is to show that ij =j—l,j= 1,2, . . . , N. Now, 
if 6' and 0" are two eigenvalues of M with 0" < 8', the eigenfunction be- 
longing to 6" must have at least one more zero in |/| < W than the ei- 
genfunction belonging to B' (see Ref. 14, p. 721). It follows then that Ui N 
must have at least N — 1 zeros in |/| < W, since the smallest number of 
zeros Uii could have in |/| < W is zero. But Ui N cannot possibly have 
more than N — 1 zeros in this interval, since, from (121), we can write 

n = 

which shows (7, N to be a function of modulus unity times a polynomial 
of degree at most W — 1. It follows then that Ui N has exactly N — 1 zeros 
in |/| < W, whence Uu has precisely; - 1 such zeros; = 1,2, . . . ,N. It 
then follows that 0,-, = 0o the largest eigenvalue of M, 0i 2 = 6\, the next 
largest eigenvalue, . . . 0i N = 0jv-i. Q.E.D. 
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We have now shown that when N is an integer, the eigenfunctions of 
M that span 9n are 

Ui(N,W;f)= £ u<p(JV,W)e»>("-i-2n)/ (128) 

where the y® are normalized eigenvectors of a(N, W): 

N E ciN.WnmvSiN.W) = ei(N,W)v^(N,W) (129) 

m=0 

i,n = 0,1, ...,N-1. 

These t/'s are also eigenfunctions of L and from (126) it then follows 
that 

N £ Sin ^ Win " m) utf (iV,W) = XiW W)vSHN, W) (130) 
m =o 7r(n — m) 

i,n = 0,1, ...,N-1. 

The matrix p(N,W) is positive definite, since 

N-i _ fW 

L 

n,m=0 



L p{N,W)nmUm - E ( die*"'*"— >&& 

m=0 J-W 

■X 



IV IN-1 
-W I 



2 



which is positive unless all the £'s are zero. Thus the \i(N,W) in (130) 
are all positive. 

We have defined the £/, as eigenfunctions of M and have ordered them 
so that (115) is true. These same Ui are a complete set of eigenfunctions 
of L and we define X, to be the eigenvalue of L corresponding to Ui. We 
shall show next that the non-zero eigenvalues of L are non-degenerate 
and that when N is a positive integer 

\o(N,W) > \i(N,W) >...> \ N -i(N,W) > 0. (131) 

The proof that if X ?^ then X is non-degenerate can be made exactly 
as in Ref. 1, equations (30)-(39). The assumption that two independent 
eigenfunctions of L, say U n and U m , belong to the same eigenvalue X ^ 
leads to the conclusion that 6 n = d m which we have shown to be false. 
The reader can find details of the proof in Ref. 1. 

We note next that for integer N, U k (N, W;fW) -» c k P k if), \f\ < 1, as 
W-*0 where Pk if) is the Legendre polynomial of degree k . This follows 
directly from the differential equation (16) which for small W be- 
comes 

± (1 _ , 2) dU k (N,W;fW) + xUk{NW;fW) + 0(W 2) = o 
df df 
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where X = l k(N 2 - 1) - 20. Thus O k (N,W) = V 4 (N 2 - 1) - y 2 k(k + 1) + 
0{W), k = 0,1, . . . , N - 1. Now the argument of Ref. 1, pages 61-62 holds 
again and it follows that for sufficiently small positive W, (131) holds. 
Since for integer N and < W < J /2 these X's are non-degenerate and are 
continuous in W, it follows that (131) holds for < W < % which is stated 
as (8). 

Proofs of the remaining claims of Sections 2.1-2.3 are all of a more 
elementary nature. Most involve a straightforward calculation. We leave 
the details of the verification of these claims to the reader. 

4.2 Asymptotlcs of the differential equation 

We now consider solutions of the differential equation 

— [cos o> - A] -^ + | - (W - 1) cos co - fl] U = (132) 
do) ow L4 J 

for < co < 7r when N is large and 

46 = BN 2 + CN+ £ D/W (133) 

where B, C and the D's are assumed independent of N. The substitu- 
tion 

1/ = , ° = (134) 

v cos co — A 



gives 



or 



Here 



d 2 G , N 2 (cosco-y Q )(cosco-yi) 

T~2 + Ti TTi G=0 < 135 ) 

aco 2 4 (cos co — AY 



dJG V cos.-f L _ j^-C +0(1) 1 G=0 . (136) 

aco 2 L 4(cos co — A) 4(cos co — A) J 

yo = B + o(^), yi-A + o(i). (137) 



Case A. 1 > B > A > -1 or k = 1.2 WN(1 - t)\ 

If 1 > B > A > -1, then, as seen from (135) and (137), U is oscillatory 
for 1 > cos u > B and for A > cos co > — 1, but is non-oscillatory in the 
interval B > cos co > A. We investigate the solutions of (132) separately 
in each of these regions and also in the vicinity of the turning points yo 
andyi. 

PROLATE SPHEROIDAL WAVE FUNCTIONS— V 1405 



Let cos u - A = t/N 2 . Then (132) becomes 

(J)- 



«w «j__^l 



dt 2 di 4(1 -A 2 ) 
so that near cos w = Awe have 



U 



U 4 = dJo (N V /f.^a) (cos w " A) )' C0S " " A 
U 6 = d 4 J (iV V ffj/a) (A " cos w) ) ' cos a> < A. 



(1-A 2 ) 

(138) 

Here To and Jo are the usual Bessel functions. We note that when cos w 
= A + u/N 



^(Wff^u) 



(1-A 2 ) 

d 4 



[wsa.r-^&fr) 



vfrL 

(139) 
(see Ref. 9, Vol. II, eq. 7.13.5, p. 86). When cos a> = A - u/N 



».«(i*«Vjf^) 

-*v|[«-v^q--[-v^:-ii 



(140) 



(see Ref. 9, Vol. II, eq. 7.13.3, p. 85). 
Now, the WKB solution of 



dx 
for large n is 



-j* - [n«£«(x) + nF(*) + 0(1)]* = (141) 



g( x ) ^,_L_ r Cie -n/£dx-l/2j(F/£)dx + C2 gn/£dx+l/2j(F/£:)dxl 

(142) 

provided x is not a zero of E(x). (See Ref. 8, Sec. 7, Lemma 2.) Applying 
this to (136) and taking account of (134), we find that for B > cos oj > A 
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an asymptotic solution of (132) is 

/ N r w . /B - cost . 

u~v,- *rm ex P (- - £ cra b V^7T7 dt 

_1 «. Cdt - ) (143) 

4 J arccos B V(B — COS £)(C0S t — A)/ 

R(u)) = \(B- cos w)(A cosco)|" 1/4 . 

Here we have chosen c 2 = in (142) to obtain a matching of U 3 and L/4 
at cos cu = A + u/N. Indeed, one finds in a straighforward way that 

U 3 (arccos (A + -jj ~ ul/4[B _ A]1/4 



Xexp(-|L 3 + iV^Vfr^"-J CL4 ) (144) 



where 






(£-A)(l-£ 2 ) 
d£ 



(145) 



^ V(B-£)(£-A)(l-H 

Comparison of (144) and (139) shows that 

d 4 = V2^iV 1/2 (l - A 2 )-^e-^ L ^- {CL * /4) d 3 . (146) 

An asymptotic solution to (132) near the turning point cos w = v is 
obtained by substituting cos a> - B = t/N 2/3 to obtain 

— + U + 0(N- 2 / 3 ) = 0. (147) 

dt 2 4(1-B 2 )(S-A) 

Thus, near cos a> = B, we find 

/ N 2/3 (cos a; - B) \ ,, AQ . 

(see Ref. 10, 10.4.1, p. 446). Here we have chosen the asymptotic solution 
of (147) that agrees with U 3 at cos a> = B - u/VN . Indeed, from Ref. 
10, 10.4.59, page 448, we have that 

/ / u \\ / N 1/6 u \ 

U 2 (arccos (B - ^=) ) = d 2 Ai (— _ R2){B _ A)]m ) 

d 2 [" N^u VIM 

~2V^L[4(l-B 2 )(J3-A)] 1 /3j 

/ 2 N 1/4 u 3/2 \ 

X " P (-5[4(l-B»)(B-A)l'«)- (149> 
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On the other hand, from (143) we find that 
t/3 ( arccos ( B — ) J ~- — — 

XeXP (-^-3[(l-B 2 )(B-A)]W (150) 
so that on comparison with (149) we must have 

9-5/6 

d 3 = =-pr N-VHl ~ B 2 ) 1/12 (B - A)V*d» (15D 

Vtt 

On the other side of this turning point the solution Vi continues as 

__/Vl/6 u 



(/ U \ \ / — iV u, 
arccos ( B + —7= ) ) = d 2 Ai ( — — — — 
V y/N/J \[4{\ - B 2 ){B - A)\W 

_ d 2 f N^u 

~v^l[4(1-J3 2 )(B-A)P' 3 



f N l ' G u 1-1/4 e p N l 'W 2 £"| 

J Sm L3V4(l-B 2 )(fi-A) + 4j 



(152) 



as seen from Ref. 10, 10.4.60, page 448. 
Applying (141)-(142) to (136) for 1 > cos a > B, we find that 



Emi ^_*mm-B 



4(cos u) — A) 
On recalling (134), we find the asymptotic formula 



rr 1 r,/ s [N C" A. /COS t — B , 

U~Ui = diR(a>)cos\— I V -dt 

L 2 Jo cos t — A 

c r w dt 1 

-- I +<t>\ (153) 

4 Jo V(cost-B)(cost-A) J 

with /?(w) as in (143). Near the turning point cos u> = yo, this becomes 

X cos ^Li . /3 ^ " =^=-~L 2 + (154) 

L2 V4(B-A)(l-fi 2 ) 4 *J 

where 



*~ B -it 



Ll Jb v ( ^_ a)(1 _^ 2) 

*»- C-7== ~M .,,. . ..-, (155) 



V(£-£)(£-.4)(l-£ 2 ) ' 
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Comparison of (154) and (152) shows that we must have 

d 2 = \^Ni/6[4(l - B 2 )]- l ' 12 (B - A)-U*d x (156) 

and 

-L l --L 2 + <t> = - (mod 2w). (157) 

Turning now to the interval A > cos a > -1, we find from (141)- 
(142) 



U~U* = 



[(B-cosa;)(A-coscu)] 1/4 



X cos — I V : dt 

L 2 J« v A - cos t 



+ C p * + ,1 ( 158 ) 

4 Jo; V(B - cos£)(A -cos t) J 

At cos co = A — u/N this becomes 

deN 1 ' 4 



l/fi ( arccos ( A - —J J 



(B-A) l/4 u l/4 ■ 



Xcos^L 5 -Ni/ 2 V / fr^" + 7 L 6 + ^] (159) 



where 



-i V (A -SKI -*»> dfc 
/..-. I . .*** — . (160) 



-s: 



" 1-i>/{B-$)iA-Ml-?) 
Comparison with (140) shows that 

d 6 = \/-N-V 2 (l ~ A 2 )^ 4 d 4 . (161) 

7T 

- L 5 + - L 6 + = - (mod 2*0. (162) 

2 4 4 

Equations (138) and (148) provide asymptotic solutions to (132) at 
the two turning points cos co = B and cos co = A. Equations (153), (143) 
and (158) provide asymptotic solutions for the regions away from the 
turning points. Equations (146), (151), (156)-(157) and (161)-(162) in- 
sure that these solutions join together. This solution is summarized in 
Eqs. (42) where the regions of validity for each piece are shown explicitly, 
and in (43)-(48). As presented there, the constant c6 of (153) has been 
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chosen as -[1 — (-l) fe ]7r/4 as it must to satisfy the inequalities shown 
in (9). 

To normalize the solution (42)-(44) we must compute 

WtmdtSgH")** (163) 

i = 1,2, . . . , 6 

where the range of integration for each gf is the range of validity for that 
g given in (42). We then require that 

£ W t - = tt (164) 

l 

since co = 2irf. 

Asymptotic forms for the Wi are readily worked out. One finds, for 
example, 



w '= d ?X 



arccos (B+l/VN) 

g\{<a)da 

dl \SL«N^ -BK-A)il-& ~\ dlL * (165> 



while, with v = [4(1 - B 2 )(B - A)]-V\ 

B+i/VN -\Ai 2 (-N 2 'Mt -B)) 



W 2 



= d| l| dt+ ( dt\ 

L Jb-i/vn Jb J 



VT^t 2 
d\ /*i M*W ll *v$)dl> d\ fi Ai 2 (-NV 6 v£)dS 



o VI -B 2 VN Jo 



VN Jo Vl-B 2 VN Jo Vl-B 2 

By using the asymptotic forms for Ai(x) (see Ref. 10, 10.4.59, 10.4.60, 
page 448) one finally finds 

W 2 d 4 N-7/i 2 = c 4.= 2cJl 

2 ttVvVT^W NV* L 2 ATi/4 

where c is independent of N. In a like manner, one finds that all the ratios 
Wi/Wi, i = 2,3, . . . , 6 vanish with increasing N. We omit the details here. 
Equations (164) and (165) now give ir ~ W\ ~ l kd\L 2 so that d\ = 
[27r/L 2 ] 1/2 . Equations (146), (151), (156) and (161) now determine all the 
cTs to have the values given in (48). 

Recall now that Uk(N,W;f) has k zeros in — W < f < W. For the so- 
lution we have just constructed, all zeros in (— W, W) are contributed by 
Ui of (153). From (154) we see that the number of zeros is given 
asymptotically by 

k = \l\N 2 NU* _c ,. N 

Ul2 3V4(B-A)(1-B 2 ) 4 JJ tt 
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Thus if we set k/N = 2W(1 - e) ~ Li/x, we must have Li~2irW(l- e) 
= irk/N which is (43). 

Finally, the two phase continuity requirements (157) and (162) must 
be met. The first of these is satisfied by the choice of C given in (45). This 
number lies between zero and 8ir/L,2 and hence is 0(1) as has been as- 
sumed throughout the development. Equation (162) is satisfied by 
choosing 6 as in (46). 

Case B. 1 = B > A > -1 or k = 0(1) 

If, in the preceding analysis, B is allowed to approach 1, the first 
turning point approaches a> = and the subinterval of (— W, W) in which 
U can oscillate becomes vanishingly small. This suggests a separate in- 
vestigation of (132)-(133) around a> = when B = 1. 

Substitute 

(2«) 1/4 . 

u> = — , — t 
VN 

into (132), where, as before, a = l — A. One finds 
d 2 U 



*■■* 



[-M-g»«ffl-» 



Asymptotically, then, U is a solution of Weber's equation D 
+ (x - l Ut 2 )D = (see Ref. 9, Vol. II, 8.2, page 116) which has bounded 
solutions only if x = k + l k where k is a nonnegative integer. We are thus 
forced to take 



(166) 



The corresponding solution is generally denoted by Dk (t) and has exactly 
k zeros (Ref. 9, Vol. II, 8.6, page 126). Thus we are led to take 

U k (u)~c 1 D k (t) = c l D k ((— j (oj (167) 

for fixed C, or a ■ 0(N~ 1/2 ), as reported in (39). Examination of higher 
order terms (omitted here) shows (167) to be correct asymptotically even 
for w = 0(N~ 1/3 ), whence the range of validity shown in (38). 

Solutions of (132) near A and in the regions away from the turning 
points can be obtained in the present case from U 3 , U*, Us and U 6 of 
Section 4.2, Case A, by letting B = 1 and C = -V^/2{k + V 2 ) in (138), 
(143), and (158). The indicated integrals in these last two equations can 
now be carried out explicitly. Equations (39) result. The constants C\, 
c 2 , . • . , C5 are then adjusted so that the solutions match asymptotically 
at the edges of their regions of validity. Finally, the solution is normal- 
ized. Again the oscillatory part near / = dominates the asymptotic 
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behavior of fl%U k (N,W;f) 2 df and we find 
•JV-i/3 /2a\i/4 



1 ViV 2 / L V 2 Jn1/6/(2«)1/4 J 

(168) 



( ^V**! 



1 Viv 

(See Ref. 13, 7.711-1, p. 885 and Ref. 9, Vol. II, 8.4.1, page 122.) This 
determines Ci and the values shown in (40) are obtained. We omit the 
straightforward but tedious details here. 

Case C. 1 > B = A > -1 or k = \2WN + (b/v) logNJ 
If, in the analysis of Section 4.2, Case A, the parameter B is allowed 
to approach the value A, the two turning points coincide at cos u = A 
and a new analysis of U in this neighborhood is now required. 
With 6 = AN 2 + CN+ 0(1) and 



ps VT=& B ' iac2 * Wl 



in (133) substitute 



cos w - A - i ■£-, U = e-WF (169) 

Np 



to obtain 



where 



&» + (1 - QT - 1 (1 - i££)F + ° (^) = ° 



(170) 



£?^i(A-C). (171) 



For large AT, then, F(£) ~ $(a,l;£) where 



and 



amhl-iRft 



a x a(a + 1) x 2 
*(a,c;x) = l+-- + -j— — '-— + 
c 1! c(c + 1) 2! 



is the confluent hypergeometric function. (See Ref. 9, Vol. I, 6.1.1, page 
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248, and 6.2.6, page 250.) Thus for cos <o near A, we have 
U ~ e 2e «W2)N(cos «-*>$(a,l;-i#V(co8 a - A)) 

as reported in (51). This expression is real. 

Solutions away from the double turning point cos co = A can be ob- 
tained from (153) and (158) by setting B = A. The integrations can be 
done explicitly. The functions hi and h 3 of (51) result when C is replaced 
by E via (171). 

There now remains the task of choosing the constants so that hi, h<i, 
and /13 join properly. We indicate a few key steps. 

When 

u 

cos co = A + 



jV"2/3 



[N 1 E8 

- arccos A - - A^/Su - -y log u 

AJ1/3Q1/2 -.T 

+ E/31og^y fe|J. (172) 

To develop an asymptotic expression for h 2 at this point, we avail our- 
selves of the formula (Ref. 9, Vol. 1, 6.13.1.2, p. 278) 



4.(a,c;,)~^(-)%^e.:''' (173) 

T(c — a) \ x / T(a) 



r(c) /e tV( \° r(c) 

(c-a)\ x ) T(a) 
where € = 1 if Im x > and « = -1 if Im x < 0. One finds 

/i 2 [arccos(A + ^)J 

e -rE0/4 r ,,. 1 "I 

~^^ C °4^-^ ) + 4-2^ l0g2 ^ (1?4) 

where y = %0N 1/3 m and where the real functions r and ^ are defined 
by 

r(---ia) = r(a)e'*<«>. 

Comparison of (172) and (174) shows that we must have 

e 2 = /3 1/2 r(E/3)e^/ 4 7V 1/2 ei (175) 

and 
irWN + ® log N - 52 log £ + ^ (£/5) _ fc £ _ | = (mod 2tt). (176) 
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When cos u = A — u/N 2/3 , from (51) one finds 

jyi/3 pN i eq 

hs ~ —pr cos — arccos A + - N l/3 (3u log u 

Vu L 2 2 2 

jyi/391/2 -.T 

while from (51) and (173) 
h 2 [arccos (a -^)] 

~KW)^-L 1r -* < " W -« h, * r -l} (m) 

Comparison of these last two equations yields 

e 3 = j9 -i/2 r ( £ ; i g)-i e ^W4 i v-i/2 e2 ( 179 ) 

to match the amplitudes, while matching of the cosine arguments gives 
(176) again. 

Now the number of zeros, k\, of (50) in the interval (0 < co < 
arccos (A + N~ 2/3 )) is seen from (172) to be given asymptotically by 

If 1 An/391/2-1 
ki ~ - ttWN - - Ni/30 + E0 log 

7T L 2 J 

while asymptotically the number, ki, of zeros of U in (arccos {A + N~ 2/3 ) 
< to < Q) is obtained from (174) as 

k2 ~ x [2 ^^ + Hm ~ 4 + ¥ l0g /,N1/8 ]' 
Thus the number of zeros of U{f) in (— W, W) is given by 

k = 2(*i + k 2 ) ~ - [ tt WW + S log 2V - 56 log § + *(£j8) - fl . 

7T L ^ / z 4J 

(180) 

This motivates the choice of £ as a root of (53). When this is done, the 
matching condition (176) is also satisfied. 

The constant e1.e2.e3 must now be determined by (175), (179) and the 
normalization requirement (9). Routine calculations show that 

arccos [A+N~ 2 ^] 



J"» arccos lA+iV - '" ] 
[Mu)]2d<0 




1 p arccos (A+N-2/3] d(l} gjff 

~-ef 7 — flog AT, (181) 

2 Jo cosu-A 3 
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Jarccos [A -N~ 2 ' 3 } 



/ «/ar 



- £M logN= £l^: logA , 



'arccos [M-Af" 2 ' 3 ] A — COS O) 3 

while 

_ r* arccos [A -N -2 ' 3 ] „ / 1 \ 

X 2 = e ( / [/i 2 M 2 dco~eiO(-)~cfO(l) (182) 

Jarccos [A+N"2/3] \JV7 

which is negligibly small compared to the first two integrals. The nor- 
malization integral thus gives 

e 2 -[l + e^']logN = 7r. 

The values (55) then follow where the factor (— l)l* /2 J is dictated by 
(9). 

We have assumed throughout this analysis that E = %(4 — C) = 0(1). 
It follows then from (53) that we must have k = 2 WN + (£/?/*■) log N 
+ 0(1). If then, we write 

k = \2WN + -\ogN\ 

as in (49), it is seen that for the root of (53) we have 

E ~ 6/0. (183) 

Consideration of the detailed nature of $ shows that E must be taken 
as the root of (53) of smallest absolute value. 

4.3 Asymptotics of \ k ( N, W) for large N 

The values of A* (N, W) for large N reported in Section 2.5 are obtained 
from the asymptotic expressions for Uk(N,W;f) given in Section 2.4 by 
means of the basic relation 

X* (N, W)= C W U k (N, W;f)*df I f V2 U k (N, W;f) 2 df. (184) 

J-W I J-l/2 

Let 

Vi = fcfff(u)da i = 1,2, . . . , 5 

Wi-JdfctMdm i = l,2,...,6 

Xi = Se?hf(w)du> i = 1,2,3, (185) 

where the ranges of integration are given by the corresponding intervals 
of validity shown in (38), (42) and (50). 
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For fixed k and large N, 1 - X* ~ ( V 4 + V 5 )/ic since 2 V,- = u\ Now 
straightforward developments yield 

M - c| I Jo . v A - cos a) du> 

J2*W Lv2-a J 

^A^vT^PJo ^L^^^J* 2. iV4/3' (186) 

Jarccos [A-N-2/ 3 J 
~£* ( ° l v r 2 Qg 7 ) 

2 J-i V(A-t)(l-t)(l-t 2 ) 2V2(1-A) 5 " 

But, from (40), ci/(AT 4/3 c|) = 0(N~ 1/3 ) so V 4 is negligible compared to 
V 5 and we have 

1-A fe ~-V 5 ~ci/2V2(1-A) 

IT 

which is (58). 

The formula (59) is obtained from 1 - \ k ~(W 5 + W 6 )Ar using (42) 
and (44). One finds W 5 ~ dl/(2irN s / 2 VB=A) and W 6 ~ %d|L 6 . 
Equations (48) now show W5 to be negligible and 1 — X* ~ Wq/tc ~ 
Lede/2ir. Insertion of the value for d& in (48) gives (59). 

Formula (60) arises from 

X = - Xi+ I eihi(a)da\. 

IT L •/arccos [A+N' 2 ' 3 ] ' J 

We have already commented in connection with (182) that the integral 
here is of smaller order than Xi so that 

X = 1 x x ~ — log N = [1 + c^*]- 1 (188) 

by (181) and (55). Since E ~ b/0 by (183), (60) results. 

Finally, the approximation (61)-(62) arises from (188) and (53) by 
solving the latter approximately for E(3. From the theory of the T func- 
tion (Ref. 10, 6.1.27, p. 256, and 6.3.3, p. 258) one finds that \f/(s) = %(7 
+ 2 log 2)s + 0(s 2 ). Inserting this in (53) one finds 

Efi~ ?-±. 

1 mi 

- log h - 7 

2 6 2 

This together with (188) is (61)-(62). 
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4.4 Asymptotics of X k (N, W) for small W 

Consider the matrix eigenvalue problem 

N £ l K(cxi,cxj)wj4,j = pfc, i = 0,1, . . . , N - 1 (189) 

/-o 

which has solutions only for those values of v = l//i for which the deter- 
minant tD{v) = \5ij — vK{cxi,cxj)\n-\ vanishes. Here, as in the rest of this 
section, we denote by \f{i,j)\N-\ the determinant of the N X N matrix 
whose element in the ith row and jth column is f(i,j), i,j = 0,1, . . . , 
N — 1. In (189) we consider the function K(- , •), the weights Wj and the 
points Xj, j = 0,1, . . . , N — 1 as given. The number c is a parameter. For 
the determinant we have the development in powers of v 

Z)b>) = 1+ L (-D n d n v n , 



where 



If now 



1 N-\ N-l 

d n = —.E'-' £ \K(cx £i ,cx £j )w £j \ n _ v 
n\ £ =o f n _,=o 



K(x,y) = Za i jX i yJ, a m =l, (190) 

o 



the development in the appendix of Ref. 21 from equation (A4) to (A9) 
can be repeated step by step with all integrals replaced by sums to show 
that for small c we have for the eigenvalues of (189) 

Hn = c 2n xo(n)[l + 0(c)] (191) 

n = 0,1, . . . , N - 1 



where 



Here 



Xo(n) = . Mnl^+yU . (192) 

\aij\n-l\rli+j\n-l 



h y = ZxlWi. (193) 

i=0 

To use this result to obtain asymptotics of X* (N, W) for small W, di- 
vide (18) by 2W, and write 

c = 2ttW, h = ^, Xj =j,j = 0,1, . . . ,N - 1. (194) 
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Equation (18) then becomes (189) with Wj = 1 and 

_, sin(x-y) ^ (-!)"(* -y) 2 " 

K(x,y) = = £ — — 

x-y o (2m + 1)! 



(-i)« ( n \ x>{-y) 2n ~ j 

= T • (195) 

Zj (2n+l)! 



For evaluation of (192) we thus have 



and 



[0, i + j odd 

aij = I (_iy+(»+;)/2 . . (196) 

\-i ±1 , i+ j even 



h y = Y. £y. (197) 

£=0 



To evaluate (192) we first note that the equations 



yield 



£ OyYj = 5fo, i = 0,1, • • • , n (198) 

y-o 



y»» V M . ' (199) 



a; 



y |n 



the reciprocal of one factor of (192). Now, from (196) we see that we can 
also write 

(_l)>+(t+;)/2 i ~\ 

an = - 



m 



f t i+ Jdt. (200) 



Insert this expression for a^ into (198) and define 



F(t)* t (-l) 3j/2 ^Yj. (201) 

;=0 J\ 



Equation (198) then reads 

2n! 



r 1 2n\ 

i = 0,1, . . . , n. 



(202) 



But F(t) is a polynomial of degree n orthogonal on (—1,1) to t\ i — 0, . . . , 
n — 1. We can write therefore F(t) = kP n (t) with P n (£) the usual Le- 
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gendre polynomial. Now 



s. 



i 2 n+1 (nl) 2 

P n (t)t"dt= ) 
-l (2n + 1)! 



(see Ref. 10, p. 786, 22.13.8-.9) so the last of equations (202) shows that 
k = {2n + l)!/2"n!(-l) n/2 . We thus have 

F(t) = kP(t)= (2n+1)! .^)L\ tn _ri(n-l) "I 

Ht) *** W 2«n!(-l)"/2 2Hn\A 2(2n - 1) ' + "J 

on using an explicit form for P n (t) (see Ref. 10, p. 775, 22.3.8) and on 
recalling the definition (201). Comparing coefficients of t n we have now 
established that 

I, KU = 22 "<" ! > 2 . (203) 

V„ |ay|»-i (2n + l)!(2n)! 

It is not difficult to obtain this result by direct evaluation of | ay | n which 
is a product of Cauchy determinants. 

We use a similar technique to evaluate the second factor in (192). The 
equations 

t h i+j Zj = Bin, i = 0,l,...,n (204) 

y-0 



yield 



Zn= \hi±Aii=±. (205) 

\hi+j\ n 



Using the definition (197) of hi+j, (205) becomes 



E x i G(x) = 5 in , i = 0,l,...,n (206) 

where we have written 

G(x)=t Zjxi. (207) 

; = 

Thus we seek an nth degree polynomial G(x) satisfying (206). The 
coefficient of x n will give the desired ratio (205). 

The Tchebyshev polynomial t n (x) (see Ref. 9, vol. 2, pp. 221-223) has 
just the properties sought. It satisfies 

f xHnix) = 0, i - 0,1, . . . , n - 1. (208) 

x=0 
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An explicit formula for the polynomial is 

to(x) s 1 

t n (x) = n\A»[(x) n {x-N)n], n=l,...,N-l (209) 

where we write (x) n = x(x — l)(x — 2) . . . (x — n + 1) and define the 
forward difference operator A by A/(x) = f(x + 1) — f(x) and A"/(x) = 
A[A n_1 /(x)]. The polynomials satisfy the recurrence 

(n + l)t n+1 (x) - (2n + 1)(2* -N+ l)t n (x) 

+ n(N 2 - n 2 )t n -i(x) = (210) 

n = 1,2, . . . , N - 2 

(Ref.9,vol. 2, p. 223, (6)). 

From (210) by using (208) we can easily calculate s£b 1 x%,(«) s S„. 
To do so, multiply (210) by x n ~ 1 and sum. Recalling (208), one finds 
2(2n + l)S n = n(N 2 - n 2 )S n - V Since S = N, we have 

Nn\ ft (N 2 - n 2 ) 

Sn = 2»1.3*5 1 ....(2» + 1)' (2U) 

It follows then that 

G(x)=^-t n (*) (212) 

is the nth degree polynomial satisfying (206). 

We now seek the coefficient of x n in G(x). The coefficient of x n in 
t n (x) is not evident from the definition (209). However, it is easy to show 
that A{x) n = n(x) n -i and that 

A»\fix)g(x)] = t ( n ) tifix)fr-Jg(x + j). 
J=o\J' 

Applying these rules to (209) we obtain the alternative expression 

t n (x) =£( n Y (x) n -j(x-N + j)j. (213) 

j=0\J/ 

It follows then that the coefficient of x n in t n (x) is 

(see Ref. 13, p. 4, 0.157-1). From (207), (212) and (213) it follows that Z n 
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= k/S n . From (205), (211) and (214), then one has 

(215) 



IJk I 1 n {N ~ J) 

I n i+j I n J_ _ J = ~n 



|h ' +jU - 1 Z " (2n + D( 2 ;) 2 

This result combined with (203), (191), (192) and (194) yields (64)- 
(66). 

Since \h i+j \o = N, (215) yields 

„ (/»)4(JV2 - j2)n+l-j 

a formula that seems difficult to arrive at by direct manipulation of the 
determinant. 



APPENDIX A 

Asymptotic Behavior of rj 

We here investigate the product (93) for large N. We adopt the ab- 
breviation W = W T . 

Suppose first that < W < % We write (93) in the form 

■^log7 7 o = Pi + P 2 + P3 (217) 



where 



p i=h l0 *(£> x ° {N+1 > w,) ) 



P 2 = 12 T 2 log WN+W ° (218) 

I N-i \ k+1 (N+l,W) 

3 N k -2WN-i ° g \k(N,W) 
In this last sum set k = N — 1 — £ and use (13) to obtain 
1 N(l-2W) \ N _ £ (N + l,W) 

P3 = — L [ °s ~ , AT TJ// v 

N e =o \ N -i- e (N,W) 

JV/tb 8 l-X £ (N,W) 

where we have written W = V2 ^W'. Now from ( 59 )> if ^ = sN > with s 
fixed and < s < 2W, 1 - MiV f W) ~ exp [-%C(B^V)L 4 (B) - NL 3 (B)] 
where C, L4 and L3 are given by (45) and (47) and B is determined as a 
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function of s by (43), namely 



1 f ' V— 

7T jB(s) (£ ~ 



Z- B{S) dt = s. (220) 



(*-A)(l-*2) 

In these formulas we now have A = cos 2wW. 

For large N, then, and fixed s, a term in (219) takes the value 

1 — A£{I\,W) i 

- [" - 1 C(B,N)L 4 (B) - NL 3 (B) 1 (221) 
where 



7T Jfl V (£-A)(l-£2) « 



= s • (222) 

JV+1 N N(N+1) N+l 

Thus 

Straightforward Taylor expansions of quantities on the right of (221) 
now give 

J= - |"l 3 (J3( S )) -s JjL 3 (B(s))1 +o(l) 

Returning to (219), we have 

1 2NWJT / t£\\ £ d ~\ 

P °-N & [*' ( B (n) ) -^ S ^W)I.-H + o(l) 

so that 

L 3 (S(s))-s-L 3 (B(s)) \ds 
o L as J 

J» 2W 2W n 2W 

L 3 ds + sL 3 - I L 3 ds 

o S=o »/o 

/»2W 

= -2 J L 3 (fl(s))«fe. (223) 
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Now recalling (220) and the definition (47) of L 3 , we have 

J»2W r B(s) I B ~ i 
ds y- JW / — d| 

J A (£ — 



N 



U-A)(l-€ 2 ) 



= -- C'dB C*diy/— 

7r J a J a * (£ - 



B-* 



/: 



(£-A)(l-£ 2 ) 
dt 



===== = 2 log (sin irW To). (224) 

V(t-B)(i-A)(l-£ 2 ) 

Details of the evaluation of the triple integral to obtain the last line here 
are given in Appendix B. 

It is not difficult to see that both Pi and P 2 approach zero as N in- 
creases. We omit the demonstration here. Our result thus far reads 

lim ^f^ = 2 log (sin irW T ), < W T < % 
jv— N 

which is (94). 

To study vo when W = W T > l k, we return to (18) and consider it 
now for arbitrary values of W. Since 

sm2ir (W + -) (n-m) 

K_^)_ r «n2,W i n- m ) + i l ( _ 1)n .„ 

ir(n — m) |_ ir(n — m) J 

(225) 
the eigenvalue equation 



N 



sin2ir(w + -)(n-m) 

£ V^ off(N.W + h 

m =o ir(n - m) \ II 

= \k(N,W+^vW(N,W + ^) 

can be rewritten on direct substitution of (225) as 

m =o ir(n — m) L \ LI J 

= [-l + X fe (iV,iy+i)][(-l)« I ;i* ) (iV,W+i)]. 

Comparison with (18) now shows that 

\ k (N,W + A = 1 + \ k (N,W) 

u<*> (N,W +^)= C(-l) m v^(N,W). (226) 
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Suppose now that 



T ±<W>< r ^± (227) 

2 2 



where n is a positive integer. Then in virtue of (226) Eq. (93) becomes 

W" = w -- 

2 
< W" < - • (229) 



Then 



where 



and 



2 



log vo = Qi + Q 2 (230) 



<r 2 [n + X (iV+l,W")] cr 2 (n + 1) 

Ql = log m> log ^^" (231) 



n -Vi n+X fe+1 (iV+l,W*) 

Q2= ? log ^Sin * (232) 

When iV is large only the terms for k near 2W"N contribute signifi- 
cantly to Q2, for if k = 2W"N(1 — «), Xk approaches 1 exponentially, 
while if k = 2W"N(l + «), X^ approaches zero exponentially. In either 
event, the summand in (232) approaches zero exponentially while the 
number of term grows linearly with N. 

Consider now 

Hc*,m-~ 2WN+ ¥*" * ***?ffi£P (233, 

k=2WN-(a/ir) logN n+\k(Jy, W ) 

where a is an arbitrary positive real number. We change from the vari- 
ables N, k to new variables A and b via the transformation 

A = -£- N = e* /A 

logiV 

b = (k- 2W"N)A k - - + 2re' /A (234) 

A 

and write 

MiW)=*(A,6). (235) 
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Then \ k+1 (N + \,W") = g(A'.b') where 

7T 

log (N + 1) 



- ■' —(f) 



and 

b'=[k+l- 2W"(N + 1)]A' = b + (1 - 2W")A + (^) • 

Thus 

£(A',6') = £(A,6) + (1 - 2 W")A -^-i + (-) 

and the summand of (233) becomes 

n + g(A,b) + (1 - 2W")A H + (£) 

l0g n + X^N.W) ° g n + g(A,b) 

A> 



= (l-2W")AL(A,6) + o/-) 



where 



L(A,b) = -£-log[n + g(A,&)]. (236) 

do 

Now write; = fc - 2WA/. Equation (233) becomes 

H(a,N) = (1 - 2W") j: Tl(Aj A)A + (fy 1 ■ 

In the limit of large N, we have 

H(a,N) ~ (1 - 2W") C° L(0,x)dx 

= (1 - 2W) log [n + g(0,x)]|?=_ H (237) 
from (236). But (60) and (235) show that 

and so 

/7(«,N) -> (1 - 2 W") log ' . 

rc + [1 + e '""J » 

Finally, since a can be chosen arbitrarily large, 

n , i>.(i-2W") 

H(a,N) - (1 - 2W") log— — = -log ( 1 + -) . (238) 

n + 1 \ n/ 
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Thus if 



we can write 



lim Q 2 = lim H(a,N), 



a 2 (n + 1) 1 

•""■Vri^ (239) 



in virtue of (229)-(231). This result is (95). 

APPENDIX B 

Evaluation of Integral (224) 



J= lim P 3 =-" f 1 ^ f B rf|V- 

JV—.*> IT J A J A I 



B-* 



a V(£-£)(£-A)(l-£ 2 ) ~ 7T J>i V(*-A)(l -t 2 ) 

x f - d * ; C'dBy/^i 

J a V(£-A)(l-£ 2 ) J? v t-B 



-JJ>/> 



(240) 



V(l-^) (1 _ ( 2 )(A _ t){A _^ 
since under the substitution u 2 = (B — £)/(£ — B) 

f>vf=iH-«> PtttV" 

J* £ - B Jo (1 + u 2 ) 2 

L 1 + w^ o Jo l + u 2 J 2 

Now change from the variables of integration £,t to ot,6 via 

1+A 1-A . 

t = — - — H sin a 

2 2 

1 +A 1-A . „ 

t = + sin 8 

2 2 M 

and obtain 

,7cl2 , a C® j sin /3 — sin a 



</=--( dB \ da 

2 J-tt/2 J-tt/2 



V(jc + sin a)(x + sin 0) 
where we write 

3 + A 

X =— — ,1 <X <«. 

1 -A 
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Changing now to variables 4>,\p through the 90° rotation %(a + 0) = <j>, 
%(a ~ £) = fc we find that 

*+»/2 cos sin yp 



dtp 



Xo /» 
d\p I 

•tt/2 J-4<~x/2 Vx 2 — sin 2 ^ + 2x cos ^ sin </> + sin 2 

d^ sin \p [log |x cos \p 

■w/2 

+ sin Vx 2 - sin 2 ^ + 2x cos ^ sin + sin 2 0|]$=-<5'+ T /2) 

Xo 
dip sin ^ 
-*/2 

. I x cos ^ + cos \p + Vx 2 — sin 2 \p + 2x cos 2 i£ + cos 2 i£ 
Xlog 



x cos i/' — cos \J/ + Vx 2 — sin 2 \p — 2x cos 2 \p + cos 2 i^ 



-r 



. , a[ou + Vfe 2 + u 2 ] 

d " log fe[feu + V^^) 



where we have set cos \p = u and 



-V** 1 . >-V^. • i -*-i- 



(241) 



Thus 



J = -2 log 7 - 2 f du log [au + Vfe 2 + u 2 ] 
fe Jo 

+ 2 f du log [feu + Va 2 -u 2 ]. (242) 

Now it can be verified by direct differentiation that when (241) holds 



Sdu log [au + Vb 2 + u 2 \ 

- (w + 1) log [au + Vb 2 + u 2 \ - u - log [u + b 2 + a Vb 2 + u 2 \ 

and 



fdu log [bu + Va 2 — u 2 \ 

= (u + 1) log [feu + Va 2 -u 2 \ - u - log [a 2 - u + b Va 2 -u 2 ]. 

It then follows readily that the last two terms of (242) both have mag- 
nitude log 2(a + fe) — 1, and that equation becomes simply 



J = -2 log - b = -2 log Vf^ = 2 log \A^ * (243) 

When A = cos 2ttW = cos 2ir(% - W T) = -cos 2irW r, (243) yields 
(224). 
The simple result (243) for the integral given by the last member of 
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(240) was first obtained by J. A. Morrison by a route involving elliptic 
functions and identities among them. 



APPENDIX C 
Commutation of L and M 

Let operators 

and 

M = j f p(f)j f + q{f) 
be given. Then 

MLg = £ df'M f K{ff)g(f') 
while 

LM§= fa d f' K WWr8<r) 

+ C b dfgitWfKiff). 

Now if 

p(a)=p(6) = 0, (244) 

we have 

MLg - LMg = £ df'g{f')[M f - M r ]K(ff) 

and so, if in addition 

M f K(ff) = M f >K(ff), (245) 

the operators commute. In the special case when K(f,f) = K(\f — f'\), 
(245) becomes 

Wf> - p(T)] ^M + IP'tf) + p'(/')] SHItfll 

df z Of 

+ [qif)-q(f , )]K(\f-f , \) = 0. (246) 
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Applying this to the operators of (110) and (111) we have p(f) = 
(V47r 2 )[cos 2vr/ - A], q(f) = V 4 (N 2 - 1) cos 2xf and a = -b = W. It is 
seen that (244) is satisfied. To verify (246) observe that 

P(f) ~ P(f') = ~ A sin x(/ + f f ) sin t(/ - /') 
P'if) + P'if) = - - sin w(f + f) cos tt(/ - f) 

IT 

q(f) ~ q(f') = | (tf 2 " 1) sin *■(/ + /') sin tt(/ - /'). 

Thus every term of (246) in the present case contains a factor 
sin ir(f + /'). This equation then is equivalent to 

. d 2 sin Aft , _ d sin Nt , .__, _ . sin M „ #AJW% 

sin t -— — + 2 cos t — — + (N 2 - 1) sin * = (247) 

at* sin £ at sin £ sin t 

where we have written t = ir(f — f). The reader can readily verify that 
(247) holds identically in t. 
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